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(54) Title: LOW VISION PANNING AND ZOOMING DEVICE 

(54) Titre: DISPOSUIF DE PANORAMIQUE ET DE ZOOMAGE POUR MALVOYANTS 



(57) Abstract 



Disclosed are several embodiments of panning and zooming devices that may assist individuals with low vision. The present 
invention employs imaging devices that capture an image and then select a smaller portion of the image for full display. The size 
of the selected portion of the captured image determines the magnification that is achieved. Further, different portions of the 
captured image can be selected to provide for panning of the image. In this fashion, a stationary mounted camera can be used 
which allows an image to be both panned and zoomed. Further, automated techniques can be used for panning and zooming control. 
Small aperture optics are used so that images can be focused for a large depth of field which allows the present invention to be 
employed without the necessity for using expensive optical focusing techniques. Also disclosed is an electronic 
telescope/microscope that provides a bright image that can be zoomed to provide different magnifications. Another embodiment 
utilizes eyewear having displays mounted in front of the users' eyes and a camera mounted on the eyewear. 

(57) Abr6g6 

L'invention concerne plusieurs modes de realisation de dispositjfe de panoramique et de zoomage pouvant aider des personnes 
malvoyantes. La prSsente invention met en oeuvre des disposers d'imagerie servant & capturer une image, puis d s3ectionner une 
partie plus petite de I'image pour un affichage integral. Les dimensions de la parte s6lectionn6e de I'image capture indiquent 
le grossissement effectue. Par ailleurs, plusieurs parties de I'image capturee peuvent etre setectionnees pour la realisation 
d'un panoramique de I'image. Ainsi, une camera montee fixe peut etre utilisee d la fois pour panoramiquer etzoomer une image. De 
plus, des techniques automatisees peuvent servir d commander le panoramique et le zoomage. Des instruments optiques & petite 
ouverture sont utilises de manure que les images puissent etre mises au point avec une profondeur de champ importante, ce qui 
permet d'utiliser la pr6sente invention sans devoir recourir a des techniques optiques de mise au point on6reuses. L'invention 
concerne egalement un telescope/microscope offrant une image lumineuse pouvant etre zoomee de facon d realiser differents 
grossissements. Dans un autre mode de realisation, on utilise un disposrrJf de lunetterie pourvu cTaffichages months en face des 
yeux de I'utilisateur, ainsi qu'une camera montee sur le dispositif de lunetterie. 
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(54) Title: LOW VISION PANNING AND ZOOMING DEVICE 

(57) Abstract 

Disclosed are several embodiments of pinning 
and zooming devices that may assist individuals with 
low vision. The present Invention employs imaging 
devicei that capture an image and then select a smaller 
portion of the image for full display. The size of 
the selp cT f d portion of the captured Ima ge determines 
the magnification that is achieved. Further, different 
portions of die captured image can be sel e cted to 
provide for panning of the image. In this fashion, a 
stationary mounted camera can be used which allows 
an image to be bom panned and zoomed. Further, 
automated techniques can be used for panning and 
zooming control. Small aperture optics are used so 
that images can be focused for a large depth of field 
which allows the present invention to be employed 
without the necessity for using expensive optical 
focusing techniques. Also disclosed is an electronic 
ss co pe/roicTOSCOpo that provides a bright image that 
can be zoo me d to provide different magnifications. 
Another embodiment ut i li zes eyewear having displays 
mounted in from of the users' eyes and a camera 
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WO 00/64140 PCI7US0Q/O9083 
LOW VISION PANNING AM I ZOOMING DEVICE 



A. EisldMih&JnYfiatifin. 

The present invention pertains generally to methods and devices for aiding 
5 perception of people with low vision and more particularly to electronic devices that 
are capable of panning and zooming. 

B, Pgy^tiQaofthgB^kgTvwd, 

Perception of objects, and particularly documents with printed matter, by 
people having low vision can be aided by providing displays that increase the size of 

10 the perceived object For example, Innovations, Inc. of Littleton, Colorado, 

provides a hand held small aperture camera device that has a long depth of field that 
can be used to image printed documents and display those documents on a standard 
television display as disclosed in U.S. patents 5,325,123 issued June 28, 1994 and 
5,461,416 issued October 24, 1995. These devices have been very useful in assisting 

1 5 individuals that have low vision in reading documents, especially documents with 
very small print. The user can adjust the magnification by changing the distance 
between the object being imaged and the hand held small aperture camera device 
without the necessity of adjusting the focus of the camera. It would be desirable, 
however, to be able to utilize this device for writing as well as for reading. Also, it 

20 would be advantageous to have a device that is capable of allowing the user to scan 
across a document while maintaining a predetermined distance from the document. 
Further, reading devices such as this require physical movement of either the camera 
or the document to scan text on the document It would therefore be advantageous 
to provide a device that allows a user to electronically pan across a document and 

25 electronically adjust the magnification of the resultant image without the necessity of 
physically moving the document or the camera. 

Various other devices exist for aiding people having low vision in various 
tasks, such as visual recognition at both short and long range. For example, many 
people having low vision use aspheric magnifying lenses to read print that is 

30 otherwise indiscernible to them. Aspheric magnifying lenses have the advantage of 
being very portable. They are, however, somewhat difficult to learn to use and 
provide a limited amount of magnification. To increase the magnification of the 
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5 aspheric portable magnifying lenses, the radius of the lens must become shorter. For 

magnifications greater than approximately ten, these types of magnifying lenses 
become impractical. 

Portable low vision devices have also been developed that utilize video 
10 5 camera technology. Devices such as these have used stationary mounted cameras 

that are mounted on a fixture mat is worn on the user's head such as a helmet Such 
devices, however, have not been successful products for use as portable low vision 
aids for various reasons. Such devices tend to be very bulky requiring the use of a 
helmet or other fixtures that are unsightly to wear. Although such devices are 
capable of providing an enlarged image, usually that image is a fixed image since the 
camera is mounted in a fixed position on the user's head mounted fixture. As such, 
the user must move their head to be able to adjust the viewing direction. Forthese 
reasons, users consider these types of devices cumbersome and unwieldy and such 
devices have not been readily accepted for use by people with low vision. It would 
15 therefore be advantageous to provide a portable low vision aid mat is not bulky or 
25 unsightly and allows the user to adjust both the magnification and viewing angle of 

the user without requiring the user to turn his or her head. 

Telescopes have also been used to aid people having low vision Standard 
optical telescopes, however, are difficult to use and normally provide a narrow 
30 20 viewing angle. Stabilization of the image at narrow viewing angles is difficult and 

limits the use of these devices. It would therefore advantageous to also provide a 
device that is capable of providing an image having a wide field of view and that is 
capable of providing varying degrees of magnification for viewing objects at both 
close and mr distances without the need for expensive or complex focusing 
25 techniques. 
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Summary of the Invention 



The present invention overcomes the disadvantages and limitations of the 
prior art by providing various embodiments for aiding individuals with low vision. 
In one embodiment, the present invention allows a long depth of field imaging 
45 30 device to be mounted on a stand to allow the user to employ the long depth of field 

device for aiding the user in reading and writing. In another embodiment, the 
present invention provides a device that employs a stationary mounted camera to 
view a document and allows the user to pan across the document and zoom to 
different magnification levels using eimer automated or manual controls. In 
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accordance with another embodiment, the present invention provides a portable 
device that uses a camera and display optics that are mounted on a conventional type 
of eyewear that allows the user to pan across the field of view of the image and to 
adjust the zoom or magnification of the device using a manual control mechanism. 
5 A further embodiment of the present invention provides an electronic 

telescope/microscope (scope) that is capable of providing a bright high contrast 
image with variable magnification that does not require complex focusing 
techniques. 

The present invention may therefore comprise a method of generating a 
1 0 magnified image of a document that has a selectable magnification and electronically 
panning the image to assist a user in reading the document comprising the steps of 
mounting a camera in a position to generate an image of the document; selecting 
portions of the image at different locations within the image to pan across the image; 
selecting the portions of the image such that the portions have different sizes that 
15 determine the selectable magnification; supplying missing pixels for the portions of 
the image; displaying the magnified image for reading by the user. 

The present invention may further comprise a method of viewing objects 
with an electronic scope comprising the steps of providing a detector matrix on a 
first end of a housing of the scope ; focusing an image on the detector matrix; 
20 selecting a portion of the image using a zoom controller; displaying the portion of 
the image as a full image on a display located on a second end of the scope; 
supplying missing pixels of the full image. 

The present invention may further comprise a portable viewing device that 
generates an enlarged image comprising eyewear adapted to be worn over the eyes of 
25 a user; a camera mounted on the eyewear that captures an image; displays mounted 
in the eyewear adjacent the eyes of the user for producing the enlarged image; a 
controller that generates control signals relating to panning and magnification of the 
image captured by the camera; an interface connected to the controller and the 
displays that selects specific portions of the image captured in response to the 
30 control signals to pan the image captured by the camera and to display the enlarged 
image on the displays with different magnitudes of magnification. 

The present invention may further comprise a method of generating an 
enlarged image in a portable viewing device comprising the steps of capturing an 
image generated by a detector that is mounted on eyewear that is adapted to be worn 
35 by a user, selecting portions of the image captured by the detector in response to 
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5 control signals generated by a controller to produce a full image display signal that 

has a magnification that is proportional to the size of the portions of the image 
selected by the control signals and has a panning location that corresponds to the 
location of the portions in the image captured by the detector, displaying the full 

10 5 image display signal or displays mounted on the eyewear adjacent to the eyes of the 

user. 

The present invention may further comprise a method of maintaining a 
substantially constant height of a small aperture camera that is scanned across a 
document comprising the steps of attaching a mounting plate to the camera; pivotally 
1 0 attaching two arms to the mounting plate with hinges that provide sufficient friction 
to support the camera such that the two arms cross and overlap; attaching rollers to 
2Q the two arms to allow the arms to roll across the document 

The present invention may further comprise a support for a small aperture 
camera that allows the small aperture camera to be moved across a document at a 
1 5 substantially constant height comprising a mounting plate that is adapted to be 
25 attached to the camera; a pair of hinges attached to the mounting plate that provide 

suffi cient fri ction to support the camera; a pair of arms attached to the hinges in an 
overlapping crossed relationship; a pair of rollers attached to the arms that allow the 
camera to roll across the document at a substantially constant height 
30 20 The advantages of the present invention are that a small aperture camera can 

be used having a long depth of field that is also capable of electronic panning and 
zooming of an object without the need to physically move the camera or object, or 
provide additional focusing. Either manual or automated procedures for panning 
and zooming can be employed. Further, these concepts can be employed in a 
25 portable device that is worn like a pair of glasses for allowing the user to perceive an 
enlarged image which can be electronically panned and zoomed. This eliminates the 
40 necessity for awkward movements by the user to direct the camera in a direction for 

viewing and provides for an aesthetic device that can be easily and worn and used 
Additionally, the present invention can be embodied in an electronic scope that 
30 allows the user to view objects at both long and close distances with variable 
45 magnification and without the need to adjust the focus of the device. As such, it 

provides a handy portable device that is easy to use. 
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Prief p^crip^n of fte Drawing 

Figure 1 is a schematic diagram of one embodiment of the present invention. 
Figure 2 is a schematic illustration of another embodiment of the present 
invention. 

5 Figure 3 is a schematic illustration of a captured image. 

Figure 4 is a schematic illustration of a full image that is displayed on the 
displays of the present invention. 
15 Figure 5 is a schematic block diagram of the architecture of the interface 

device. 

1 0 Figure 6 is a flow diagram of the steps performed by code by the 

microprocessor of the interface device. 

Figure 7 is a schematic illustration of another embodiment of the present 
invention. 

Figure 8 is a schematic illustration of a captured image. 
1 5 Figure 9 is a schematic illustration of a full image that is produced on the 

display of figure 7. 

Figure 10 is a schematic illustration of the electronic scope of the present 
invention. 

30 Figure 1 lis a schematic illustration of another embodiment of the present 

20 invention. 

Figure 12 is a schematic illustration of a support device that can be used with 
the long depth of field camera of the present invention. 
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PetatM Description of the Preferred Embodiment 



Figure 1 is a schematic illustration of one embodiment of the present 
25 invention. In accordance with this embodiment, a camera or other type of detector 
that is capable of generating an image is used that has small aperture optics. This 
allows the camera 10 to focus over a long depth of field A typical camera for use in 
accordance with this embodiment is sold by Innoventions, Inc. 5921 South 
45 Middlefield Road, Suite 102, Littleton, Colorado 80123-2877. The camera 10 may 

30 include an illumination source on its lower surface to help in illuminating an object 
such as a document to be read. The camera 10 is mourned on a stand 14 that holds 
the camera 10 above a writing surface 16. Any document or object that the user 
50 desires to view can be placed on the writing surface 1 6 in alignment with the camera 
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10. The writing surface 16 allows the user to write on the document or object while 
simultaneously being able to view an enlarged image of that object on television 1 8. 
Television 18 can comprise a standard television or any type of viewing device such 
as a monitor, flat panel display, projection display, etc., that is capable of displaying 
5 an enlarged image of the object that is being viewed by camera 1 0. The 

magnification of the image is determined by dividing the field of view of the display 
18 by the field of view of the camera 10. Hence, increasing the size of the display 
18 and decreasing the size of the field of view of the camera 10 will increase the 
magnification. With standard print in the range of 1 0 point to 1 4 point, it has been 
10 determined that ability to view 1 inch of a document placed on writing surface 1 6 
provides the necessary context information to allow the user to read the document 
If the camera 10 is held at 18 inches above the writing surface 16, mis results in a 
view angle of approximately 3 degrees. If the television display 18 provides a field 
of view of 45 degrees, that results in a magnification of 15X. 
15 As also shown in figure 1, an interface device 20 is provided that receives the 

standard video signal 22, which comprises a 1 volt peak to peak standard video 
signal, and transforms that into a display signal 24 that is applied to television 1 8. 
Interface device 20 may up-convert the signal to a standard carrier band frequency 
for display on channels 3 or 4 of the television 1 8. 
20 In addition, the interface device 20 of figure 1 may provide an amplified 

standard video signal that can be applied to monitor inputs of the display 18. 
Interface device 20 may also include processing capabilities to processes control 
signals 26 that are generated by the zoom and pan control device 28. The zoom and 
pan control 28 can comprise any desired type of manual device for generating 
25 control signals for zooming and panning the image. For example, zoom and pan 
control device 28 can comprise a joy stick, a finger slide device, a mouse, or any 
other type of manual control device. Further, the zoom and pan control device 29 
can be built into the housing of camera 10. The zoom and pan control device 28 
generates the control signals 26 that indicate the zoom and pan that is desired by the 
30 user. The zoom and pan control device generates control signals 27 that are 
transmitted from camera 10 to the interface device 20. 

The term "zoom" in this case is used to mean the variable magnification that 
can be selected by the user in a fashion similar to a zoom lens. As explained in more 
detail below with regard to figures 3 and 4, the amount of magnification or "zoom" 
35 that is selected by the user is achieved by selecting a subset of pixels of the image 
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generated by camera 10 for display as a full display on television 18. Since the 
subset of pixels has a certain field of view that is less than the entire field of view of 
the camera 10, a magnified image can be generated. A large subset of pixels will 
produce an image that has greater magnification than the image produced by the 
5 entire camera field of view 10, while a smaller subset of pixels will produce an 
enlarged image of even greater magnification. 

The panning control provides the panning signals that determine the location 
of the selected subset of pixels on the image captured by the camera 10. As 
indicated above, this is explained in more detail with regard to figures 3 and 4 
10 below. The panning device may locate the pixel subset in two dimensions on the 
image generated by the camera 10. If a joystick type of device is used, the selected 
portion of the image may be determined by moving the joystick in both the forward 
and back directions as well as side to side directions to locate positions on the 
captured image in two directions. Zooming may be achieved, for example, by 
1 5 rotating the joystick in a clockwise or counter clockwise direction or by using an 

additional joystick or other manual control device. In this fashion, the document that 
is placed on the writing surface 1 6 can be panned and zoomed to locate and magnify 
any desired portion of the document 

Figure 2 is a schematic illustration of another embodiment of the invention. 
20 As shown in figure 2, a document 26 is placed on the bottom portion of a support 
device 28. The document 26 is aligned with a camera 30 that generates an image of 
the document 26. The image is then transferred to an interface device 32 via 
connector 34. The support 28 supports a display device 36, such as a fiat panel 
display, having a display screen 38. Display 36 can comprise any type of desired 
25 display including flat panels, cathode ray tube displays, projection displays, etc. 
Interface device 32 is shown as mounted on the back of the display 36 but can also 
be mounted on the support 28. The embodiment of figure 2 also includes a 
controller 40 that generates control signals 42 that are applied to the interface device 
32. As indicated above, these control signals control the panning and zooming of 
30 the image generated by the camera 30. In this fashion, portions if the document can 
be panned and magnified to a desired level to aid in reading of the document 26. 

Figures 3 and 4 illustrate the manner in which panning and zooming may be 
performed in accordance with the present invention. Figure 3 illustrates the captured 
image 44 that is captured by the camera 30 (figure 2) or the camera 10 (figure 1). 
33 The captured image 44 is the entire image that is captured by the camera and is 
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5 dependent upon the field of view of the camera. As indicated above, the field of 

view of the camera divided into the field of view of the display device determines 
the magnification mat can be obtained. Of course, with regard to the display device 
illustrated in figures 1 and 2, the field of view of the display device is dependent 
10 5 upon how close the user is positioned to the display, mother words, if the user is 

closer to the display, the letters projected on the display will appear larger. With 
regard to the embodiments of figures 10 and 1 1, as disclosed below, the distance of 
the users eye from the display is substantially fixed which fixes the field of view of 
the display for the user. 
10 The captured image 44 of figure 3 comprises a plurality of pixels that create 

the captured image. In most cases, the pixel images are arranged in rows and 
columns within the borders of the captured image 44. Figure 4 illustrates the manner 
in which portions of the captured image can be selected for viewing as a full image 
46. Referring again to figure 3, a portion of the captured image 44 can be selected as 
15 illustrated by selected portion 48. The selected portion 48 comprises a subset of the 
25 pixels of the captured image 44. The selected portion 48 has the same format and 

ratio as the captured image 44, but merely defines a subset of the larger set of the 
pixels of the captured image 44. Selected portion 50 indicates another subset of 
pixels in the captured image 44. Similarly, selected portion 52 is another subset of 
30 20 me pixels of me captured image 44. By sequentially selecting these selected 

portions, using a controller, the user can pan across the captured image 44, as shown 
in figure 3. The panning shown in figure 3 shows that the selected portions start 
with selected portion 48, pans to selected portion 50 and then pans to selected 
portion 52. As shown, the panning is performed in two dimensions. Of course, if a 
25 document is being read, the user may wish to just pan across in the horizontal 
direction of the captured image 44 to read the words in the row as illustrated in 
figure 3, rather then panning in two directions at once. Once a line of text has been 
read, the selected portion may then be move to the next line of print and panned 
across in a horizontal direction across that line of print 
30 As shown in figure 4, the selected portion 50 (figure 3) is displayed as a full 

45 image 46 mat is a magnified or enlarged version of the captured image 44. This is 

displayed on one of the displays 18, 36 of figures 1 and 2, respectively. As can be 
seen, if the selected portions 48, 50, 52 are made smaller, a greater magnification or 
a more enlarged image can be generated on the display 18, 36. If the selected 
5G 35 portions 48, 50, 52 are made larger the magnification of the image on display 1 8, 36 
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5 is decreased. In this fashion, the size of the selected portions determines the amount 

of magnification or zoom that is created. In other words, the selected portions 48, 
50, 52 have a smaller angular field of view than the larger captured image 44. This 
smaller field of view, when divided into the field of view of the display screen 38 
10 5 generates an indication of the magnification that is obtained Similarly, the 

magnification of the selected portion over the magnification of the captured image 
can be obtained by dividing the field of view of the captured image by the field of 
view of the selected portion. As shown in figure 3, the field of view of each of the 
selected portions 48, 50, 52 is approximately one-fourth of the field of view of the 
10 captured image 44. As shown in figure 4, the full image 46 displays the selected 
portion 50 at approximately 4X to 4.5X the size of the captured image 44. 

Since the selected portions 48, SO, 52 of figure 3 are a subset of the pixels of 
the captured image 44, additional pixels must be generated to produce a full image 
46 on the displays 1 8, 36 as illustrated in figure 4. The generation of additional 
1 5 pixels can be performed by any desired technique including duplication of 
25 neighboring pixels, interpolation techniques, etc. Interpolation can be performed in 

two dimensions on the display 1 8, 36 by standard interpolation techniques, such as 
disclosed in US Patent 5,739,870, issued April 14, 1998, and the patents that are 
cited therein. The video scaling that is shown in figures 3 and 4 comprises standard 
30 20 techniques that can be incorporated in software or hardware, and is more fully 

disclosed below with respect to figure 6. 

Figure 5 is a schematic block diagram of one example of implementing the 
hardware of the interface device 20 of figure 1 and interface device 32 of figure 2. 
As shown in figure 5, a camera input 56 is received from the camera and is applied 
25 to an analog to digital converter 58. The A/D converter 58 digitizes the video stream 
56 which is then transmitted to the bus 60. The combined video signal 56 may also 
40 include horizontal and vertical sync information that is also digitized and applied to 

the bus 60. Microprocessor 62 retrieves this data from a bus 60 and processes this 
data in accordance with the zoom input 64 and the pan input 68. Microprocessor 62 
30 selects the location and size of the selected portions in accordance with the zoom 
45 input 64 and pan input 68 and then generates interpolated values for missing pixels. 

This information is then stored in the video RAM 70. The video RAM output 70 is 
applied to a digital to analog converter 72 which generates an analog output that is 
sent to the video display. Of course, figure 5 illustrates only one particular manner 

50 
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of implementing the present invention. Programmed gate arrays or digital signal 
processors (DSPs) can be used to perform these functions. 

Figure 6 is a schematic flow diagram of the steps that may be performed by 
program code that is utilized in conjunction with the architecture of figure 5. As 
5 shown at step 76, the microprocessor determines the number of vertical and 
horizontal pixels that are selected based on the zoom input The zoom input 
provides a control signal that indicates the size of the selected portion of the image. 
That control signal is used by the microprocessor to determine the number of pixels 
(count signals) that are to be selected from the captured image. At step 78, the count 
10 signals are then stored by the microprocessor based upon the number of vertical and 
horizontal pixels that are selected by the zoom input In other words, the pixel count 
for the size of the selected portion is generated in step 76 and that pixel count is men 
stored in memory at step 78. At step 80, the pan input generates a control signal mat 
indicates a starting point of the selected portion in bom the vertical and horizontal 
15 directions of the selected portion. This can constitute an actual pixel count in the 
horizontal direction and scan line count in the vertical direction. These starting 
points are then used in conjunction with the vertical and horizontal counts signals 
that are stored in step 78 to set vertical and horizontal counters that count the vertical 
and horizontal size of the selected portion of the captured image. At step 82 of 
20 figure 6, interpolated data is then generated in accordance with standard 

interpolation techniques as disclosed above. The interpolated data provides the 
missing pixels for the selected portions that are to be displayed as a full image, as 
indicated in figure 4. At step 84, the microprocessor loads the processed data, 
including the selected pixel elements of the selected portions along with the 
25 interpolated data into the video RAM 70 (figure 5). Data is then read from the video 
RAM into a D/A converter 72 to produce the video output signal at step 86. 

Figure 7 is a schematic illustration of another embodiment of the present 
invention. The embodiment in figure 7 is similar to the embodiment of figure 2 with 
the exception that it uses an automated control device rather than a manual control 
30 device. As shown in figure 7, a document 88 is placed on the lower portion of the 
stand 90 in alignment with a camera 92. The camera 92 generates an image of the 
document 88 that is transmitted to an interface device 94. The interface device 94 
generates a video signal that is applied to the display 96 for viewing by the user 98. 
Figure 7 also includes an automatic detector/controller 1 00 that is capable of 
35 detecting an indicator such as indicator 1 02 that is mounted on the head of the user 
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5 98 or indicator 1 04 that is mounted on the user's finger or other part of the user's 

body. The detector/controller 100 is capable of detecting movements of the 
indicator and generating control signals 106 in accordance with those movements. 
These types of optical detectors are typically referred to as a head mouse or finger 
10 5 mouse. These devices translate the movements of a user's head or finger into 

directly proportional movements of a cursor on the screen. In mis manner, a user 
may select a portion of the document to be read and then be able to pan across the 
document by moving the user's head or finger. The head mouse and finger mouse 
products use an infrared device that illuminates the reflective indicator. The 
10 detector/controller camera 100 then tracks the position of the reflective point to pan 
a cursor across the screen to indicate the starting point of the selected portion. For 
example, the cursor control signal may indicate the upper left hand of the corner of 
the selected portion. Alternatively, two separate inputs can be generated based upon 
indicator 1 02 and indicator 104. In that instance, one of the inputs could be used to 
15 control the zoom of the image that is generated while the other control signal can be 
25 used to control the panning of the image. These types of devices are available from 

several different manufacturers. For example, Origin Instruments Corp. of Grand 
Prairie Texas provides a head mouse device. Similarly, MadenTec of Edmonton, 
Alberta provides a similar head mouse device. GyroPoint Inc. of Saratoga, 
30 20 California, provides a pointer device that uses a wireless communication connection 

to generate control signals. Similarly, a foot controlled mouse can also be used to 
generate control signals. A typical foot mouse in marketed by Hunter Digital of Los 
Angeles, California. 

Figure 8 is a schematic illustration of the captured image 108 that is captured 
25 by the camera 92 (figure 7). As shown in figure 8, selected portions 110, 112, 114 
are shown as portions that are panned in a horizontal direction across the captured 
40 image 108. 

Figure 9 illustrates the manner in which the selected portion 1 1 2 (figure 7) is 
displayed as a full image 1 16 on the display 96. In this fashion, an enlarged and 
30 panned image can be generated in the same manner as indicated above. 
45 Figure 1 0 is a schematic illustration of a electronic scope that is capable of 

viewing and generating enlarged images at both short and long distances. Hie 
embodiment of figure 10 uses optics 1 18 that include focusing optics as well as a 
small diameter aperture (not shown) that is capable of focusing images with a long 
50 35 depth of field. In other words, the embodiment of figure 1 0, if it has sufficient light, 
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can image objects from near distances of just a few inches up to infinity without the 
need for providing different or adjustable optics 1 1 8. The image generated by the 
optics 118 is projected onto a CCD matrix 120. The CCD matrix generates an 
optical signal 122 that is transmitted to the image processing hardware 124. A zoom 
5 control device 126 generates a zoom control signal 128 that is transmitted to the 
image processing hardware 124. The processed image information 130 is men 
transmitted to a display 132 for viewing by the user. The display 132 may also 
include optical focusing elements (not shown) to focus the image of the display onto 
the user's eye. 

10 The electronic scope 1 17 of figure 10 can be used in a fashion similar to a 

telescope to view objects such as documents for reading or other objects of long 
distances, such as signs, in the same fashion as a telescope. In this fashion, the user 
may hold the electronic scope 1 17 with the display 132 adjacent to the users eye to 
view images generated by the CCD matrix 120. The zoom control 126 is used to 
15 select portions of the image mat are captured by the CCD matrix 120. The zoom 
25 control signals 128 are used by the imaging processing hardware 124 to determine 

the selected portions. The selected portions may comprise progressively smaller 
portions of the captured image on the CCD array 1 20 centered around the middle of 
the captured image. In this fashion, a progressively magnified image can be 
30 20 generated that is centered around the center of the image captured by the CCD 

matrix 120. Of course, selection of the selected portions is performed by generating 
control signals 128 using the zoom control 126. 

As indicated above, the magnification of the image is based upon the viewing 
angle of the user on the display 132 divided by the viewing angle of the selected 
25 portion of the image produced by the CCD matrix 120. For example, if the CCD 
matrix 120 has a viewing angle of 1 0 degrees and the selected portion of the image 
40 generated by the CCD matrix 1 20 is 3 degrees, the viewing angle of the generated 

image is 3 degrees. This number is divided into the viewing angle of the user on the 
display 132 which is fixed by the optics of the display. Further, the viewing angle of 
30 the display 132 may be 30 degrees such that magnification of 10X can be generated 
45 with the 3 degrees viewing angle of the selected portion of the image on the CCD 

matrix 120. 

As a practical implementation, it may be desirable to fix optics 1 1 8 so that 
field of view of the CCD matrix 120 is fixed at a predetermined value of between 6 

50 

35 degrees to 10 degrees. This allows the scope to be used in a hand held manner with 
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an adequate amount of stabilization of the image. Assuming that the optics of the 
display 1 32 fixes the field of view for the user at values between 30 degrees and 40 
degrees, this would produce magnifications of between 3X to 6.6X without 
zooming. If a selected portion of the CCD matrix 120 generates a field of view of 3 
S degrees, a magnification of between 10X and 13.3X can be produced on the display 
132. Since it has been found that the field of view of less than 3 degrees does not 
allow for proper stabilization for handheld devices, magnifications in the order of 
10X to 14X are the largest practically achievable magnifications assuming the 
largest field of view of the display is approximately 40 degrees. Magnifications of 
10 approximately 15X have been found to be median magnification for readers having 
low vision. This parameter sets the range of the fields of view for both the detector 
20 optics and display optics. Since the display optics are currently limited to 

approximately 40 degrees, and detector optics under 3 degrees field of view are very 
difficult to hold in a steady fashion, magnifications of approximately 14X can be 
15 achieved. Innovations in the display optics to increase the field of view to 45 
25 degrees or greater will greatly enhance the ability of the electronic scope 1 17 of 

figure 10 to generate a steady and greatly magnified image. 

Additionally, it has been determined that the desired field of view for both 
close and far imaging is approximately the same. For example, 1 inch at 1 8 inches 
30 20 provides the proper field of view for reading textual material, while 1 foot at 18 feet, 

which is the same ratio, provides the proper field of view for reading signs and other 
objects at a distance. Hence, zooming is not required when reading documents at 
close range or reading signs at a distance. This ratio provides a viewing angle of 
approximately 3 degrees. 
25 Figure 1 1 is a schematic illustration of another embodiment of the present 

invention. As shown in figure 1 1, a user 134 is able to view magnified images using 
40 eyewear 136. Eyewear 136 includes displays 138 and 140 that are positioned in 

front of the user's eyes that include optics that allow the user 1 34 to focus on the 
images generated by the displays 138, 140. Eyewear 136 may be similar in 
30 appearance to standard sunglasses and provide a light and portable device for 
45 viewing enlarged images. 

Eyewear 136 of figure 1 1 also includes a camera device 142 that is mounted 
on the side of the eyewear 136 and is directed in a forward direction to view the area 
in front of the user 134. The field of view of the camera 142 provides a fairly wide 

50 

35 field of view for the purpose of panning the captured image, as set forth in more 
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detail below. The camera 142 may comprise a very high resolution video camera 
that generates a high resolution image with a number of pixels. In this fashion, a 
large field of view can be provided by the camera 142 and very small selected 
portions can be selected for display, while maintaining an image on the displays 138, 
• 5 140 mat has sufficient resolution. In this fashion, rjanning can be accomplished 
across a wide field of view. 

As also shown in figure 11, a beh mounted interface device 144 is connected 
to the camera 142. The interface device 144 is also connected to a manual controller 
146. In the same fashion as described above, the image captured by the camera 142 
10 can be panned and zoomed using the controller 146. If the camera 142 generates an 
image having a wide field of view, such as 45 degrees, the controller 146 can be 
used to pan across the entire captured image. In this fashion, the user 134 can view 
different portions of the image without moving his/her head Since a very high 
resolution image is generated, a very small portion of the image can be selected to 
15 obtain the desired amount of magnification. Again, the field of view of the selected 
portion can be divided into the field of view of the display 138, 140 to determine the 
amount of magnification. If a selected portion of the image captured by the camera 
142 has a field ofviewof3.5 degrees, and the displays 138, 140 have a field of view 
of 35 degrees, a magnification of 1 OX can be produced. The field of view of 3.5 
20 degrees in a captured image of 45 degrees will result in a small selected portion of 
the image that only uses approximately 12.5% of the number of pixels in the 
captured image. If the displays 138, 140 use a one-quarter VGA format, 
interpolation techniques can provide an image that still has a high degree of clarity. 
By using a camera 1 42 in accordance with figure 1 1 , that has a wide field of 
25 view, a wide range of panning can be provided in both vertical and horizontal 

directions. Of course, lower resolution cameras can be used with narrower fields of 
view mat provide the same resolution image for the displays 138, 140. In that case, 
a smaller running area would be provided, but the selected portions of the image 
would be larger to encompass more pixels. 
30 The zooming and panning control of figure 1 1 can be provided directly on 

the interface device 144 or as a separate controller 146 coupled to the interface 
device as illustrated in figure 1 1. In any case, the manual operation of the controller 
146 can provide both panning and zooming of the captured image in the manner 
desired by the user 134. 
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5 Figure 12 is a schematic illustration of a support 148 on which a small 

aperture camera 150 can be mounted. As shown in figure 12, the support 148 has a 
mounting plate 152 that can be releasabry mounted to the camera 150. For example, 
a Velcro pad can be provided on the mounting plate 1 52 to attach to a velcro pad on 
10 5 camera 150. In this fashion, the camera 150 can be removed from the support 148 as 

desired. Hinges 154, 156 that use hardened metal are attached to the end portions of 
the mounting plate 152. Arms 158 and 160 are attached to hinges 154, 156, 
respectively. Arms 158, 160 are provided in an overlapping, crossed relationship as 
illustrated in figure 12. Rollers 162, 164 are attached to the lower portion of the 
10 arms 158, 160 respectively. Rollers 1 62, 1 64 allow the support to easily roll across a 
printed document to maintain a preselected height for the camera 1 50 above the 
document. The hinges of 154, 156 provide sufficient friction to maintain the arms of 
158, 160 in a predetermined location while supporting the weight of the camera 150. 
Downward pressure can be applied on the camera 1 50 to adjust the hinges 154, 156 
15 to position the camera 150 closer to the document on which the rollers 162, 164 are 
25 placed. Similarly, the arms 158, 160 can be manually adjusted to provide a greater 

distance between the document and the camera 150. This allows for easy adjustment 
for spacing of the camera from the document. A zoom controller 166 can also be 
provided on the camera 150 to adjust the magnification of the generated image in the 
30 20 manner described above. 

The present invention therefore provides several embodiments that produce 
enlarged images that can be panned and adjusted for different magnification levels. 
This can be accomplished by using manual control devices or automatic control 
devices. Further, the present invention can be employed in a mobile device on the 
25 form of eyewear that is not bulky or unattractive. Further, in accordance with the 
present invention, an electronic scope can be provided that is capable of imaging at 
40 both short and long ranges and does not require focusing. In addition, the electronic 

scope can provide variable magnitude images using a zoom control device. Further, 
the present invention can employ a support device that is capable of holding a 
30 camera that can be manually scanned across a document at a predetermined level to 
45 provide a predetermined magnification. 

The above specification, examples and data provide a complete description 
of the manufacture and use of the composition of the invention. Since many 
embodiments of the invention can be made without departing from the spirit and 

so 

35 scope of the invention, the invention resides in the claims hereinafter appended. 
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What Is claimed is: 

1 . A method of generating a magnified image of a document that has a 
selectable magnification and electronically panning said image to assist a user in 
reading said document comprising the steps of: 

mounting a camera in a position to generate an image of said document; 

selecting portions of said image at different locations within said image to 
pan across said image; 

selecting said portions of said image such that said portions have different 
sizes that determine said selectable magnification; 

supplying missing pixels for said portions of said image; 

displaying said magnified image for reading by said user. 

2. The method of claim 1 wherein said step of selecting portions of said image 
at different locations further comprises the step of: 

using a hand operated controller to select said different location. 

3. Hie method of claim 1 wherein said step of selecting portions of said image 
such that selected portions have different sizes further comprises the step of: 

using a hand operated controller to select said portions of said image having 
selected sizes. 

4. The method of claim 1 wherein said step of selecting portions of said image 
at different location comprises the steps of; 

detecting an indicator attached to said user; 

generating control signals in response to movement of said indicator, 

using said control signals to select said portions of said image at different 
locations. 
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5. The method of claim 1 wherein said step of selecting portions of said image 
such that said portions have different sizes comprising the steps of: 

detecting an indicator attached to said user, 

generating control signals in response to movement of said indicator; 

using said control signals to select said portions of said image having 



6. A method of enlarging a portion of an image of a document with variable 
magnification and electronically panning said image to assist in reading said 
document and writing on said document comprising the steps of: 

placing said document on a writing surface; 

mounting a long depth of field camera on a stand above said writing surface 
in alignment with said document; 

generating said image of said document; 

displaying said image on a display; 

using an interface device to reverse said image that is displayed on said 
standard television display in two directions so that said image in aligned on said 
display to correspond to the position of said document on said writing surface; 

using a control device coupled to said interface device to electronically pan 
across said image and electronically vary said magnification of a portion of said 
image at different magnification levels. 

7. The method of claim 6 wherein said step of using a control device to 
electronically vary the magnification of a portion of said image further comprising 
the steps of: 



capturing said portion of said image; 
displaying said portion of said image as a full image on said display; 
50 supplying missing pixels of said full image. 
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8. The method of claim 7 wherein said step of supplying missing pixels further 
comprises using interpolation techniques to supply said missing pixels. 

9. The method of claim 3 wherein said step of using said control device to 
electronically pan across said image further comprises the steps of: 

capturing a portion of said image; 

displaying said portion of said image on said display as a full image; 
using said control device to capture a different portion of said image; 
displaying said different portion of said image as a full image on said display. 

10. A method of claim 6 wherein said step of using said control device to 
electronically pan said image further comprises the steps of: 

using a control device that detects the location of an indicator and generates 
control signals that select portions of said document in accordance with said location 
of said indicator. 

11. The method of claim 10 wherein said step of using a control device 
comprises the steps of; 

using a camera to detect said indicator, 

determining said location of said indicator, 

moving the location of said selected portions of said documents in 
accordance with said location of said indicator. 

12. A device for generating a magnified image of an object comprising: 

a small aperture electronic camera mounted on a stand and aligned to capture 
an image of said object; 

a display that displays said magnified image; 

a controller that generates control signals relating to panning and 
magnification under the control of a user, 
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an interface device connected to said controller that selects specific portions 
of said image captured by said camera in response to said control signals and 
modifies said specific portions for display as a full image on said display. 

13. The device of claim 12 wherein said controller is a manual controller. 

14. The device of claim 12 wherein said controller is an automatic controller. 

15. The device of claim 12 wherein said display is a flat panel display. 

1 6. The device of claim 12 wherein said display is a television. 

1 7. Hie device of claim 1 2 wherein said controller comprises: 

a detector that detects the location of an indicator attached to said user and 
generates said control signals in response to movement of said indicator. 

18. A method of viewing objects with an electronic scope comprising the steps 
of: 

providing a detector matrix on a first end of a housing of said scope; 

focusing an image on said detector matrix; 

selecting a portion of said image using a 200m controller, 

displaying said portion of said image as a full image on a display located on a 
second end of said scope; 

supplying missing pixels of said full image. 

19. An electronic scope for generating an image of objects at both close and far 
distances and providing variable magnification of said image comprising: 

a detector matrix disposed at one end of said electronic scope that generates 
an electronic representation of said image; 

optics disposed adjacent to said detector matrix to produce said image on 
said detector matrix, said optics providing a long depth of field that is sufficiently 
long to generate said image as an infocus image on said detector for both reading 
documents and viewing objects as distances; 
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a zoom controller that selects a portion of said electronic representation of 
said image; 

a display that generates a display image of said portion of said electronic 
representation of said image as a full image on said display; 

an image processor mat selects said portions in response to said zoom 
controller and supplies missing pixels of said full image. 

20. The electronic scope of claim 19 wherein said display comprises a CMOS 
detector matrix. 

21. The electronic scope of claim 19 wherein said detector matrix comprising a 
CCD matrix. 

22. The electronic scope of claim 19 wherein said zoom controller comprises a 
pair of buttons disposed on a housing of said scope. 

23. The electronic scope of claim 1 9 wherein said zoom controller comprises a 
sliding switch disposed on a housing of said scope. 

24. The electronic scope of claim 19 wherein said zoom controller comprises a 
rocker switch disposed on a housing of said scope. 

25. A portable viewing device that generates an enlarged image comprising: 
eyewear adapted to be worn over the eyes of a user; 

a camera mounted on said eyewear that captures an image; 

displays mounted in said eyewear adjacent said eyes of said user tor 
producing said enlarged image; 

a controller that generates control signals relating to panning and 
magnification of said image captured by said camera; 

an interface connected to said controller and said displays that selects 
specific portions of said image captured in response to said control signals to pan 
said image captured by said camera and to display said enlarged image on said 
displays with different magnitudes of magnification. 
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26. The portable viewing device of claim 25 wherein said displays comprise 
ferroelectric liquid crystal displays. 

27. The portable viewing device of claim 25 wherein said controller is a manual 
controller. 

28. The portable viewing device of claim 27 wherein said manual controller is a 
joystick. 

29. The portable viewing device of claim 25 wherein said interface further 
comprises: 

logic circuitry that selects image fields of said image captured by said camera 
in response to said control signals and generates interpolated values for pixels 
missing from said enlarged image. 

30. The portable viewing device of claim 29 wherein said logic circuitry 
comprises a gate array. 

31. The portable viewing device of claim 29 wherein said logic circuitry 
comprises a microprocessor. 

32. The portable viewing device of claim 29 wherein said logic circuitry 
comprises a digital signal processor. 

33. A method of generating an enlarged image in a portable viewing device 
comprising the steps of: 

capturing an image generated by a detector that is mounted on eyewear that is 
adapted to be worn by a user; 

selecting portions of said image captured by said detector in response to 
control signals generated by a controller to produce a full image display signal that 
has a magnification that is proportional to the size of said portions of said image 
selected by said control signals and has a panning location that corresponds to the 
location of said portions in said image captured by said detector; 

displaying said full image display signal or displays mounted on said eyewear 
adjacent to the eyes of said user. 
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34. A method of maintaining a substantially constant height of a small aperture 
camera that is scanned across a document comprising the steps of: 

attaching a mounting plate to said camera; 

pivotally attaching two arms to said mounting plate with hinges that provide 
sufficient friction to support said camera such that said two arms cross and overlap; 

attaching rollers to said two arms to allow said arms to roll across said 
document. 

35. A support for a small aperture camera that allows said small aperture camera 
to be moved across a document at a substantially constant height comprising: 

a mounting plate that is adapted to be attached to said camera; 

a pair of hinges attached to said mounting plate that provide sufficient 
friction to support said camera; 

a pair of arms attached to said hinges in an overlapping crossed relationship; 

a pair of rollers attached to said arms that allow said camera to roll across 
said document at a substantially constant height 
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